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BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention relates to a hyperlink having a time dependency and 
related to a video. 

2. Description of the Related Art 

Hypertext systems, such as the World Wide Web (WWW), contain objects, i.e. 
electronic documents, which are creatively linked to each other. During a session, a user 
device is connected via a browser to a content server including an object and content is 
exchanged between the user device and the content server. The exchange of content occurs 
over the internet using, for example, a hypertext transport protocol (HTTP) for hypertext 
documents. The HTTP protocol messages are carried in Transmission Control 
Protocol/Internet Protocol (TCP/IP) messages. It is also possible to transmit voice or video 
content over the internet. For the establishment of voice and/or video multimedia session 
protocols like Session Initiation Protocol (SIP) and H.323 are used. Multimedia sessions can 
be established via SIP by selecting links from HTTP hypertext documents, if the browser is 
equipped with multimedia capabilities. SIP is a client-server protocol in which requests are 
generated by one entity (the user or client) and sent to a receiving entity (the server). 
Contacting the server of the new object may be accomplished by looking up the domain name 
of the new server in a Domain Name Service (DNS) and determining the correct IP address. 
The DNS is actually its own network. If one DNS server does not know how to translate a 
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domain name, it asks another, and so one, until the correct IP address is found. The request 
from the browser is sent to the IP address and may be redirected to where the actual object is 
connected. The object returns a response through the chain. 

Each object which the user device may access may include one or more 
hyperlinks that link to another place in the same document or to an entirely different object. 
The hyperlinks occur within a certain area in the object and may include a picture or phrase, a 
word, an icon, or any other visual representations. The hyperlinks in these objects may be 
selected by clicking when the cursor is within the area of the hyperlink. When the hyperlink is 
selected, the browser of the user device switches over to a new object that is associated with 
the hyperlink. 

Prior art video content include hyperlinks and other WWW type content 
associated with video programs. However, the hyperlinks and WWW type content that are 
associated with prior art video content are transmitted in parallel to the video program without 
being associated directly to spatial objects within the video stream. Therefore, these 
hyperlinks are not bound to objects in the video. It is desireable to navigate in 
video/multimedia content using hyperlinks bound to the video content. Similarly, the prior art 
does not define mechanisms for implementing a seamless switchover between video contents. 
In the prior art, there is always an observable delay when establishing a new session after a 
hyperlink has been selected from, e.g., a web page displayed by the side of a television 
picture. 
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Furthermore, in the prior art, there are no mechanisms having parallel 
multimedia streams active for potential switchover periods while retaining only one multimedia 
stream toward the user device. 
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SUMMARY OF THE INVENTION 

It is an object of the present invention to provide a system in which link 
information is associated with video such that a user may select a hyperlink in 
video/multimedia content. 

According to the invention, a user of a video browser selects a link displayed 
with the video while viewing the video. Once the link to a new session is selected, the 
establishment of a connection to the new session is initiated. The links may be represented by 
three dimensions including the x and y coordinate ranges of the link at a given moment in time 
in the video image with the last dimension in each case being time that the link appears during 
the playing of the video. For example, the video may show a person walking from room to 
room and the hyperlinks may be associated with different furniture in each of the rooms. 
Therefore, the hyperlink for a chair in the kitchen is only selectable for the portion of time that 
the chair is displayed. The link may be to a site containing information about the history of the 
furniture (i.e. if the furniture is an antique) and/or information about how to buy the furniture. 
Furthermore, it is conceivable that the hyperlink may be represented in three dimensional 
space with a fourth dimension being time if the video is in three dimensions. 

The link information may be transmitted as a link stream to the video browser 
parallel to the video information so that the link information is available to the video browser 
when the link is in effect. In this embodiment the establishment of a connection to a new 
session is made by the video browser. 
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The link information may alternatively be stored in the content server in a 
database with a mapping of time and coordinates to the link information. In this embodiment, 
the establishment of a connection to a new session may be made by the content server for the 
video browser. 

In another embodiment, a call processing server may be arranged between the 
content server and the browser. In this embodiment, the call processing server may be used to 
initiate the establishment of a new session, thereby reducing bandwidth required to the 
browser. Moreover, a media proxy arrangement may optionally be connected with the call 
processing server. 

In yet another embodiment, the link information may be downloaded to the 
video browser from the content server at the start of the video session before the video 
information is transmitted to the video browser from the content server. In this embodiment, 
the mapping of time and coordinates to the link information occurs in the video browser. 

Each of these embodiments may include the advance establishment of a 
connection to a new session of an approaching hyperlink to provide a smooth switchover to the 
new session should the approaching hyperlink be selected. 

Furthermore, a switchover application may be used to control the switchover 
from the original session and content stream to a new session and control stream to which a 
selected hyperlink in the original content stream points. The switchover application may be 
downloaded from the original content server to the browser, the call processing server, or a 
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service control means associated with the call processing server. The switchover application 
may be adapted to the applications required by the content with which it is associated. 

The various features of novelty which characterize the invention are pointed out 
with particularity in the claims annexed to and forming a part of the disclosure. For a better 
5 understanding of the invention, its operating advantages, and specific objects attained by its use, 
reference should be had to the drawing and descriptive matter in which there are illustrated and 
described preferred embodiments of the invention. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

In the drawings, wherein like reference characters denote similar elements 
throughout the several views: 

Fig. la is a basic schematic diagram showing a system for processing a time- 
dependent hyperlink according to the present invention; 

Fig. lb-Id are flow diagrams showing the general steps for selecting a hyperlink 
within a video and transferring control between servers; 

Fig. 2a is a schematic diagram showing a first embodiment connection between 
a content server and a video browser of the present invention in which the link information is 
transmitted to the video browser in a link stream; 

Fig. 2b is a schematic diagram of the connection of Fig. 2a showing an optional 
call processing server; 

Fig. 2c is a schematic diagram of the connection of Fig. 2a showing an optional 
media proxy with the call processing server; 

Fig. 2d is a schematic diagram of the connection of Fig. 2c showing an optional 
service control means connected to the call processing server; and 

Fig. 3 is a schematic diagram showing a second embodiment connection 
between a content server and a video browser of the present invention in which the link 
information is stored in a link database in the content server; and 

Fig. 4 is a timing diagram showing the transmission of a switchover application 
and content stream from a content server to a browser. 
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DETAILED DESCRIPTION OF THE PRESENTLY PREFERRED EMBODIMENTS 

Referring to Fig. la, a browser 100 is used with a user input/output device 140 
including a display device 150 and an input device 160 such as, for example, a computer 
mouse and/or a keyboard. The browser 100 connects to a content server 200 to retrieve 
information from an electronic document in the content server 200 via a channel 110 and 
display the information to the user. The session between the browser 100 and the content 
server 200 is conducted over an IP network using a data transfer protocol such as, for 
example, a Real Time Transport Protocol (RTP) which separates the electronic document in 
media appropriate packets (i.e. a video frame) for transmission. The electronic document 
transmitted to the browser from the content server 200 may contain hyperlinks which link to 
other documents which may be in content server 200 or may be in other content servers. The 
link data is transmitted to the browser 100 using another protocol which includes more error 
checking, such as User Datagram Protocol/Internet Protocol (UDP/IP) or Transmission 
Control Protocol/Internet Protocol (TCP/IP). To select a hyperlink, the user operates the input 
device 160 to select the position in the electronic document at which the hyperlink is shown 
(i.e., the x, y coordinates on the user display). According to the invention, the electronic 
document in the content server 200 is a video and the hyperlinks are viewable objects in the 
video of the content server 200. Therefore, the position of the hyperlink also includes time as 
one of the coordinates. Content reference such as Uniform Resource Locator (URL) and/or 
session description information of the selected hyperlink is determined from the coordinates 
selected by the user. If for example, the hyperlink is linked to an electronic document in 
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content server 202, the browser initiates a connection to a new session the electronic document 
in content server 202. To establish the new session, the new content server 202 must be 
contacted and a description of the session to be established and/or an identifier to specify the 
content requested (URL) must be delivered to the new content server 202. These steps may be 
performed by a Session Initiation Protocol (SIP). The description of the new session to be 
established may be described in a Session Description Protocol (SDP). The SDPs may be 
multicast via a well-known multicast address. A more detailed description of the RTP is found 
in H. Schulzrinne, S. Casner, R. Fredrick, and V. Jaconson, "RTP: a transport protocol for 
real-time applications," Request for Comments (Proposed Standard) 1889, Internet 
Engineering Task Force, Jan. 1996, the entire contents of which are incorporated herein by 
reference. A more detailed description of SIP is found in DRAFT-ffiTF-MMUSIC-SIP at 
www.itf.org, the entire contents of which are incorporated herein by reference. Once the new 
content server is connected, the browser switches the user input/output device 140 to the new 
content server 202 and drops the connection to the content server 200. 

Referring to Fig. lb, the present invention includes the association of hyperlinks 
with the video as three dimensional objects where the dimension include the location on the 
screen (x, y) at which the hyperlink appears in the video and the time (t) during the playing of 
the video at which the hyperlink appears. It is also conceivable that the video may be three 
dimensional wherein the hyperlink has x, y, z, and t coordinates. The first step according to 
the invention is to associate the hyperlinks with a time and place in the video by coordinates, 
step 10. That is, each hyperlink is associated with coordinates indicating an area of a display 
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and a time during the playing of a video at which the hyperlink appears at those coordinates. 
As a user is viewing the video via browser 100, the user may select one of the hyperlinks 
associated with the video, step 20. Upon selection of the hyperlink in the video by the user, a 
content reference for the selected hyperlink is determined based on the coordinates selected and 
the time of the selection, step 30. The content reference may include a Uniform Resource 
Locator (URL) to establish a session to the new content, session description information to 
reflect the characteristics of the new content, and the requirements for the browser. The URL 
may also include a time displacement from the start of the new content at which to start playing 
the new content. For example, the hyperlink may point to a portion, such as a scene, of a 
video which is located in the middle of the video. The URL may also specify a limited area in 
the picture frames from the time displacement onward. The content server may focus the 
picture to display only this limited area. Alternatively, the showing of the limited area in the 
picture frames and the focussing as specified by the URL may be performed by the browser 
itself, provided that the video coding of the stream from the content server has sufficient 
precision. However, the time displacement may also be indicated otherwise. The content 
reference may further comprise an SIP Call Processing Language (CPL) script that is sent in 
the session establishment signalling and used by call processing servers (described later) to 
assist in finding the required content. The CPL script may comprise contact instructions to 
alternate locations to be contacted to reach the required content. Similarly, the content 
reference may also comprise executable content that specifies how the selection of the 
hyperlink appears to the user. The content reference may include instructions to play a video 
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clip at a hyperlink selection and control the establishment of the connection to the referred 
content. Finally, the content reference may specify whether a smooth switchover or immediate 
switchover is required and at which point in time the switchover should occur. After the 
content reference is determined, connection to the new session is initiated, step 40. When the 
connection to the new session is established, the browser 100 begins the new session and ends 
the previous session from which the new link was selected, i.e. the browser 100 switches over 
to the new session, step 50. 

Regarding the dimension information (x-range, y-range, time) for the content, 
the x-range and y-range of a hyperlink at a given time window (i.e., time range) may be 
provided explicitly in the link stream. Alternatively, an algorithm may be used by the browser 
that selects an area on the screen based on visual characteristics of the image on the screen. 
The algorithm may comprise adaptive learning characteristics to enable it to select objects of 
frequently occurring types of patterns or persons. An algorithm that tracks a moving object in 
the video stream for a specified time may also be provided in the browser. The starting 
coordinates, starting time, and duration that the tracking should be performed may be specified 
to the tracking algorithm. 

The algorithm may be built into the browser or may be downloaded to the 
browser when the browser initiates a session with the content that the algorithm is associated 
with. Similarly, the learning information may also be downloaded. The algorithm makes a 
decision whether an object has been pointed to by a pointer device based on pointing 
coordinates and time. 
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The existence of a link may be indicated to a viewer of the video in various 
ways. In one embodiment, the video content itself may contain information indicating visually 
to a user the existence of a hyperlink. In another embodiment, the browser may display a 
visual object pointing to the video content having the object having the associated hyperlink. 
In yet another embodiment, the browser may display the bounds of the object in accordance 
with the boundaries of the object provided explicitly in the link information contained in the 
link stream from the content server. 

Referring to Fig. 2a, an embodiment of the invention is shown in which a user 
views the video using the video browser 100 connected to the content server 200 which 
contains the video to be played. In this embodiment, the video and content reference 
information for the hyperlinks in the video are transmitted in two separate streams on 
respective first and second channels 110, 112. A link stream containing the content reference 
information for the hyperlinks is transmitted in parallel with the video to the video browser 
100. The link stream includes the information required to establish the link, i.e., content 
reference and information sufficient to visualize the existence of the hyperlink. In this 
embodiment, the link stream provides the content reference for the hyperlinks that are 
presently viewable and selectable in the video. For example, the video may show a person 
walking from room to room and the hyperlinks may be associated with different furniture in 
each of the rooms. Therefore, the hyperlink for a chair in the kitchen is only selectable for the 
portion of time that the chair is displayed. Accordingly, the link stream contains content 
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reference information for the hyperlink to the chair only for the duration of time that the chair 
is displayed. 

When the user makes a selection in step 20 of Fig. lb, the video browser 100 
has all the information it needs to establish a connection, i.e. perform steps 30, 40, and 50 of 
Fig. lb. Once the connection to the electronic document of the selected link is established, the 
browser 100 begins a session with the new link. The electronic document to which the 
hyperlink is linked may be any type of electronic document and does not have to be another 
video. The linked document could be a web page,, a hypertext document, a video clip, and 
audio clip, or any other type of electronic document. 

In an optional embodiment according to a flow diagram of Fig. lc, the browser 
may initiate the establishment of a session towards the content pointed to by the link, i.e., the 
link session, before the user selects the hyperlink. In this embodiment, the content reference 
such as the address (i.e., URL) towards the content pointed to by the link and the link 
visualization information (coordinates and time ranges) for a hyperlink is transmitted to the 
browser 100 before the hyperlink is viewable in the video, step 30. The browser then initiates 
the establishment of a connection to that hyperlink on a separate channel while the original 
content is still being viewed by the user, step 40. Accordingly, when the user selects the 
hyperlink, step 22, a smooth switchover is achievable in step 50 because a parallel connection 
and optionally the content stream is already established by the time the hyperlink appears in the 
video and can be selected by the user. If the hyperlink is not selected, the browser merely 
drops the newly made connection and maintains the current session, step 52. This embodiment 
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is costly and wastes bandwidth. However, it provides a smooth switchover from the current 
session to the new session when the hyperlink to the new session is selected. The smooth 
switchover is possible because the session establishment delay and the content loading delay at 
the content server are eliminated. Similarly, the delay of searching to the right position within 
the content, e.g. in a CD-ROM device, is eliminated. In this embodiment, the content 
reference information must be transmitted to the video browser 100 by the link stream in 
advance of the actual video which shows the hyperlink so that the advanced establishment of 
the link is possible. The advanced connection may be selectively made for those links which 
are likely to be selected, or other criteria. 

Similarly, a smooth switchover can be used when returning to the original 
content from a selected content either when the content has reached its end or when a user 
explicitly decides to do so. When approaching the end of a branched-to content, the browser 
100 starts the re-establishment of a session towards the original content from which the link 
was selected. The procedure for re-establishment of the original content is similar to the 
establishment of an upcoming link. In some cases, if the content reference indicates that the 
link content of a selected link is sufficiently short, the session to the original content server 
may be maintained at link selection. However, when the link content of the selected link 
reaches its end, it may be necessary to request the original content server to restart transmitting 
the content. If the original content server does not maintain content state, a time displacement 
at the branched-from link is indicated to it. 



15 



By Express Mail ff EL447232140US 

In a further optional embodiment shown in Fig. 2b, a call processing server 300 
is arranged between the browser 100 and the content server 200. The parallel first and second 
transmission channels 110% U2 9 are arranged between the content server 200 and the call 
processing server 300. When the user selects a hyperlink, the coordinates and time of the 
selection are transmitted to the call processing server 300 from the browser 100. The call 
processing server 300 performs the steps 30 and 40 of Fig. lb, thereby selecting the content 
reference and establishing the session, i.e., setting up a connection to a new content server 202 
based on the coordinates and the time of the selection and initiating the connection to the new 
content server 202 to which the new link is connected, over a new channel 118. The call 
processing server 300 also establishes the new session in step 50 of Fig. lb by dropping the old 
session from the first content server 200 and connecting the new content server 202 to the 
browser 100, step 50 of Fig. 1, when the connection to the new session is established. The 
call processing server 300 may establish this new session in advance of the selection of the new 
session by the user to enable a smooth transition. The benefit of using the call processing 
server 300 is that only one session is connected to the video browser 100 at the viewer terminal 
140 at any one time, which may save bandwidth. 

In yet a further embodiment shown in Fig. 2c, a media proxy 400 may 
optionally be attached to the CPS 300. In this embodiment, the control channels between the 
browser 100 and the content server 200 are connected via the CPS 300. However, the data 
channels carrying the individual media components are routed from the content server 200 to 
the browser 100 via the media proxy 400. On this embodiment, the CPS 300 instructs the 
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media proxy 400 to perform connections on the data channels. The data channels may 
comprises a media mix including audio, video, and data streams. The different media can be 
added, dropped, or replaced dynamically during a call via instructions from the CPS 300. The 
media proxy 400 identifies the different types of media components from the multimedia 
stream and perform switching of the individual media components separately. 

In yet a further embodiment shown in Fig. 2d, a service control means 500 may 
be connected with the CPS 300. In this embodiment, control signals and the link stream are 
transmitted to the service control means 500 from the browser 100 and the content server 200. 
The data streams are transmitted via a media proxy 400. If the media proxy 400 is not used, the 
data stream is transmitted to the CPS 300 directly. 

Each of the embodiments shown in Figs. 2a-2d and discussed above may include 
the advanced connection of a link for a smooth switchover. Furthermore, a switchover 
application that performs the smooth switchover to a new session may optionally be used. The 
switchover application is a generic program for performing several tasks and may be responsible 
for one to many links associated with a video, i.e., the switchover application is associated with 
the video content and knows the links it is responsible for. The switchover application is stored 
in the content server with the video. 

The switchover application may be downloaded from the content server of the 
video to the browser 100 (Fig. 2a), the CPS 300 (Fig. 2b and 2c), or to the service control means 
500 (Fig. 2d). The switchover application is executed by the browser 100, CPS 300, or service 
control means 500. The switchover application is responsible for receiving and interpreting the 
link stream information. The switchover application may establish the sessions toward links 
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selectable by a viewer of the video. A link selection by a user is indicated to the switchover 
application from the browser 100, and the switchover application hands control over from the 
current session to a new session, A particular switchover application may include any one or 
more of the following steps: 

• Downloading given contents at given points in time; 

• Playing contents at given points in time; 

• Checking content server availability; 

• Selecting from several content servers depending on server load status; 

• Requesting a content server to prepare a content for transmission (e.g., load from a 
secondary storage to a buffer in case of failure in one or more of the bulieted steps listed 
here); 

• Requesting a content server to start transmitting the prepared document; 

• Requesting a content server to start transmitting content from a given time displacement; 

• Requesting the downloading of a new switchover application from a content server for the 
content referred to by a selected link; 
Establishing sessions to new content at given points in time; 

Determining round trip delay between the browser and the content server and adjusting 
switchover times on the determination; 

Determining permanent terminal or terminal location specific implications to general 
session establishment time and adjusting switchover schedules based on the determination 
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(e.g., session establishment time overhead in a mobile terminal such as a wireless local 
area network); 

• Submitting received call processing language scripts to assist session establishment; 

• Performing procedures needed to join a multicast session (e.g. inform recipient address to 
be added to a multicast address expansion list and indicate multicasting content server about 
new receiving party); 

• Reserving network resources for a session under establishment or a link or data stream 
being resumed; 

• Freeing network resources for a session being cleared or a link or data stream being 
paused; 

• Performing video/audio content switchover at a given point in time; 

• Comparing link content reference information with user preference attributes and 
browser/network capabilities, in case of failure to satisfy the preference attributes (e.g., 
content cost, content categorization, content encoding, and decision not to visualize a link); 
and 

• Cancelling the visualization of a hyperlink to the user in case of failure or erasing of the link 
from the link stream and/or in case of failure in any of the previous listed steps. 

If a session of the selected link is sufficiently short, the switchover application 
may remain in control and may decide not to release the session toward the original video from 
which the link was selected as shown in the flow diagram of Fig. Id. In this case, the switchover 
application may further include the following steps, in addition to the previous steps: 
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• Establishing a new session toward the link content at a given point in time, step 72; 

• Pausing the video/audio content stream of the original content at switchover, step 74; 

• Resuming the video/audio content stream of the original content at switchover back to the 
original content, step 76; and 

• Releasing the session toward the link content after switchover back to the original content, 
step 78. 

Some of the above steps may be omitted or combined. Furthermore, a hyperlink 
may point to more than one new content to be connected one after the other. For example, when 
a hyperlink is selected, the browser may first be connected to a first new content such as a video 
clip. After the first new content finishes, the browser may then be connected to a second new 
content, so that the browser is connected to both the first content and then the second content in 
response to the selection of one hyperlink. The above described procedure steps may also be 
performed in the previous embodiments where the downloading of a switchover application is 
not used, but instead the functions of a switchover application are resident on the browser or call 
processing server. 

The benefit of switchover applications is that they allow the procedures used prior 
to and after the link selection to vary from one link to another and therefore, can be tailored to 
the content they are associated with. 

In one embodiment incorporating the switchover applications, the link streams 
includes one or more link content reference and switchover preparation schedules coupled with 
link visualization information. The switchover preparation schedules may be specified using 
simple ascii tag notation. The switchover application is arranged to interpret this notation. An 
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example of a link stream schedule transmitted in the link stream is shown in Fig. 4. At time tO a 
switchover application is downloaded to a browser. The link stream is transmitted to the browser 
in addition to the switchover application. A first switchover preparation schedule includes: 

• tl-k: availability check 

• 1 1 -k+e: new switchover application downloading from URLx 

• 1 1 -k+e+e: new session establishment; 

• tl : visualization of hyperlink to new session; and 

• tl+e: session switchover if hyperlink selected (or new session disconnection if no selection 
by user). 

Furthermore, a second switchover preparation is transmitted after the first 
switchover preparation, the second switchover preparation including: 

• t2-k: server selection; 

• t2-k+e: new session establishment; 

• t2: visualization of hyperlink to new session; and 

• t2+e: switchover to new session if hyperlink is selected (or disconnection of new session if 
hyperlink is not selected). 

The switchover preparation schedules are not necessarily fixed and can be 
adapted to specific environments by returning feedback information from the browsers to the 
content server pointed to by the selected link. While the new session to the content of the 
selected link is being established, the browser measures the time needed to establish the session. 
The time needed for session establishment may be may be calculated several ways. If the reply 
time from the sending of SIP invite message to receipt of an OK answer message from the 
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content server includes the preparations for sending the content stream (i.e., loading of content 
from secondary storage from indicated time displacement onwards and memory allocation etc.), 
the reply time can be used to adjust the time in the switchover preparation schedule which 
indicates how much time before the visualization of the link, the link session must be 
established. If the reply time does not involve content stream preparation, the content stream 
preparation time must also be calculated and added to the session establishment time to 
determine the time indicating how much before the visualization of the link the link session must 
be established. Similarly, the round trip delay from the browser to the content server may be 
measured to determine how much earlier the request to start transmitting the prepared content 
must be issued. 

The feedback information collected from the browsers can be used to adjust the 
times in the switchover preparation schedules presented in the link stream. In an additional 
embodiment, the switchover preparation schedules associated with the switchover application 
may also be made specific to different receivers by determining the network address prefixes for 
different browsers. Similarly, the browser may simply report failures to establish a link session 
and obtain the content requested. A difference between the session description information 
indicated in the content reference and the session description information indicated by the link 
content server may also be reported by the browser. This information may be used to correct the 
session description information in the original content server. Similarly any conflict between the 
attributes indicated in the content reference and attributes indicated by the new content server 
can be reported. 
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The second switchover preparation schedule shown in Fig. 4 does not specify that 
a new switchover application downloading is not required. This scenario may occur when the 
content referred to by the link at t2 is under the same administration as the original content. In 
this embodiment, the preparations needed for switchovers are known to the existing switchover 
application. 

In another embodiment, the switchover application encapsulates the link stream. 
That is 5 the information related to the links (coordinates, content reference, and schedules) is 
contained within the switchover application. Therefore, this embodiment does not require that a 
link stream associated with the switchover applications are downloaded periodically. 

In yet a further embodiment, a switchover application may be downloaded to the 
browser 100, CPS 300, or service control means 500 either prior to the transmission of the link 
stream and actual content or at a given time displacement from the start of the video. If the 
switchover application is downloaded prior to the transmission of the link stream and actual 
video, it may itself establish the multimedia session and request the transmission of the link 
stream. If the switchover application is downloaded at a given time displacement from the start 
of the video, the need for downloading may be indicated by the content server or it may be 
pushed by the content server to the browser 100, CPS 300, or service control means 500. 

A given switchover application may be responsible for a limited set of links in the 
link stream. When a switchover application has processed all links in its responsibility, it may 
start downloading of another switchover application to take its place. 
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Similarly, links in the link stream may be assigned to different switchover 
applications. In this case, the several switchover applications may be active simultaneously at 
the browser 100, CPS 300, or service control means 500. 

Switchover applications may be specific to a link, a set of links within a content, a 
content or a set of contents. Similarly, different switchover applications may be used in the same 
content. 

Generally, because the user may navigate through several links, a history of old 
switchover applications is cached either in the browser or the proxy. Only those switchover 
applications which still have remaining unencountered links pending are cached. If the last link 
under the responsibility of a given switchover application has been selected or the old application 
is no longer available, the switchover application is downloaded when navigating back to the 
original content. At that point the original content server is contacted and provided with the time 
displacement from the beginning of the original content at which a link was selected. 
Alternatively, a link identifier is provided to the original content server. This information is used 
by the original content server to download a porrect switchover application and to start playing 
video content stream at correct time displacements, i.e., return to the point in the original video 
content at which the selected link was selected. The content server includes a mapping from the 
time displacements and or indices to switchover applications. 

An alternative to providing advanced connection, i.e., smooth switchover, for a 
hyperlink selected in step 20, the currently connected content server 200 may optionally 
provide a string of video clips to be played while a connection to the new session is being 
established. These video clips play while the new session is being established so that the 
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viewer screen displays a coherent video during the transition to the new session. As is 
apparent, this option is not required if the advanced establishment of the new session is made 
as described above. 

In another alternative to making an advance connection to an upcoming link, the 
video browser 100, the call processing server 300, or the service control means 500 may 
simply check the availability of an upcoming link. If the check reveals that the link is 
unavailable, the visual representation of the link will not be displayed. Also, the links 
displayed by the video may be dependent on prior criteria specified by the user. For example, 
only links which pertain to prior interest categories may be displayed. As another alternative, 
the display of links may be dependent on parental/employer blocking. The criteria may also 
include subscriber information, such as whether the user is a paid member for links which 
allow only subscribers to access the information, or other price information such that only 
sessions below a certain price are presented. 

Referring to Fig. 3, instead of transmitting the link data to the video browser 
100 in parallel to the video, the link data including the session description information may be 
stored in a data base 250 in the content server 200. Information to visualize the existence of 
the link may transmitted with the video to the browser 100 as the video is playing, i.e., being 
displayed. The database 250 provides a mapping of time and coordinates to the content 
reference (address e.g., URL, session description information) of the hyperlinks. In this 
embodiment, when a link is selected by a user in step 20 of Fig. 1, the video browser 100 
transmits the coordinates and time of the selection to the content server 200. The content 
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server 200 retrieves the content reference from the database 250 based on these coordinates 
and time of the selection. The content server 200 may establish the session toward the new 
session itself (forwarding) or it can transmit the content reference for the selected link to the 
video browser 100 (redirection) so that the video browser 100 establishes the new session. 

A smooth transition may be established in this embodiment by the content server 
200 as follows. As a link to another session becomes available, the content server 200 
establishes a connection for the video browser 100 so that it is available for a smooth 
switchover if the hyperlink for that session is selected by the user in step 20. The connection 
to the new session may then be redirected to the browser 100 by the content server 200 by 
merely switching the output to the browser 100. 

As an alternative, instead of having the browser 100 query the database 250 in 
the content server 200 when a hyperlink is selected, all link content reference information in 
the database 250 for the video to be displayed may be downloaded from the content server 200 
to the browser 100 at the start of the session with content server 200, before beginning of the 
video transmission from the content server 200 to the video browser 100. When a link is 
selected in step 20 of Fig. 1, the browser 100 contains the content reference information 
necessary to establish the connection in the downloaded file. The information is retrieved 
based on the coordinates and the time at which the hyperlink was selected by the user. 

The invention is not limited by the embodiments described above which are 
presented as examples only but can be modified in various ways within the scope of protection 
defined by the appended patent claims. 
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